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O ( ST > Abstract: Encapsulating packets includes receiving packets at a queue of an encapsulator. The following operations are re- 
O pealed until certain criteria are satisfied. A number of packets are accumulated at the queue. A current encapsulation efficiency 

associated with the accumulated packets is determined. A next encapsulation efficiency associated with the accumulated packets 
Q and a predicted next packet is determined. If the current encapsulation efficiency satisfies an encapsulation efficiency threshold and 
^ if the cuirent encapsulation efficiency is greater than the next encapsulation efficiency, the accumulated packets are encapsulated. 

Otherwise, the packets continue to be accumulated at the queue. 
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METHOD AND SYSTEM FOR ENCAPSULATING PACKETS 



TECHNICAL FIELD OF THE INVENTION 

This invention relates generally to the field of data communication and more 
specifically to a method and system for encapsulating variable-size packets. 

5 BACKGROUND OF THE INVENTION 

Encapsulating packets in a communication system may involve the use of multiple 
queues for buffering packets waiting to be encapsulated. Packets at different queues, 
however, may experience different waiting times prior to encapsulation, also known as 
packet delay variation. Packet delay variation may introduce unwanted jitter into the 

10 communication system. Moreover, encapsulation according to known techniques may 
result in sub-optimal bandwidth usage of a communications channel. Furthermore, 
packets associated with Internet Protocol (IP) traffic may involve datagrams of variable 
size, which may affect encapsulation for optimal bandwidth usage. Consequently, 
encapsulating packets while controlling jitter and enhancing bandwidth utilization has 

15 posed challenges. 

SUMMARY OF THE INVENTION 

In accordance with the present invention, disadvantages and problems associated 
with previous techniques for encapsulation of variable-size packets in data communication 

20 may be reduced or eliminated. 

According to one embodiment, encapsulating packets includes receiving packets at 
a queue of an encapsulator. The following operations are repeated until certain criteria are 
satisfied. A number of packets are accumulated at the queue. A current encapsulation 
efficiency associated with the accumulated packets is detennined. A next encapsulation 

25 efficiency associated with the accumulated packets and a predicted size and arrival time of 
the next packet is determined. If the current encapsulation efficiency satisfies an 
encapsulation efficiency threshold and if the current encapsulation efficiency is greater 
than the next encapsulation efficiency, the accumulated packets are encapsulated. 
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Certain embodiments of the invention may provide one or more technical 
advantages. A technical advantage of one embodiment may be that the size of an 
encapsulation section is adjusted in response to a current encapsulation efficiency and a 
predicted jitter in an effort to control jitter while maintaining efficiency. If the 

5 accumulated packets satisfy an encapsulation efficiency threshold, the packets may be 
encapsulated to maintain efficiency while controlling delay jitter. Another technical 
advantage of an embodiment may be that a delay associated with receiving predicted 
packets may be determined and if the delay satisfies a jitter requirement, the accumulated 
packets may be encapsulated to control jitter. Yet another technical advantage of an 

10 embodiment may be that encapsulation sections packets may be formed into cells to 
improve jitter. The encapsulation sections may be formed into cells so that wasted, or 
additional, capacity in the cells is avoided. 

Certain embodiments of the invention may include none, some, or all of the above 
technical advantages. One or more other technical advantages may be readily apparent to 

1 5 one skilled in the art from the figures, descriptions, and claims included herein. 

RRTRF DESCRIPTION OF THE D RAWINGS 

For a more complete understanding of the present invention and its features and 
advantages, reference is now made to the following description, taken in conjunction with 
20 the accompanying drawings, in which: 

FIGURE 1 illustrates an embodiment of a system for encapsulating packets to form 

encapsulation sections; 

FIGURE 2 illustrates an embodiment of the formation of cells from encapsulation 

sections; 

25 FIGURE 3 illustrates an embodiment of a cell flow; 

FIGURE 4 is a flowchart illustrating a method for encapsulating packets; 
FIGURE 5 illustrates another embodiment of the formation of cells from 

encapsulation sections; and 

FIGURE 6 illustrates another embodiment of a cell flow. 
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TIFT Ml TP "«nnpnnN OF thf, drawings 

^TT^tta^system 10 for encapsulating packets to form encapsn.atron 
sections. System 10 adjusts the size of the seetrons in order to achieve a hrgh 
encapsu,ation efficency while ensuring satisfaction of a jitter requirement. In genera!, 
encapsu.ating a ,ar g e section inereases jitter. However, encapsulating a smaH sectron, 
whiie racing Jitter, results in lower efficiency. System 10 predicts jitter and effic.ency, 
and adjusts the size of the encapsulation sections to reduce jitter whiie mamtammg 

efficiency. , . _ on 

System 10 receives packets from real-time flows 15 and non-real-tnne flows 20, 
encapsulates the received packets to form encapsulation sections, forms the encapsulation 
sections into ce„s, and transmits the ce„s to a receiver 70. Packets may be assocrated wrth 
datagrams of different sizes or variab.e-size packers. For example, a packet may comprrse 
an BP packet or datagram, whreh may he of any suitable size. Ceils may generally be 
associate* wittr frxed-size packet of data. For example, a ceH may comprise a movmg 
pictures experts group-2 packet (MPEG-2 packet). Any outer suitable packet of fixed or 
variable size may be formed into ceils without deviating from the concept of thrs 

"^Real-time flows 15 transmit rear-time ttaffie, and non-rear-time flows 20 transmit 
non-real-time traffic. According to one embodiment, real-time flows 15 may compnse 
, any de,ay-sensitive traffic, for example, voice data such as voice over D? (VOIP) or vrdeo 
on demand (VOD) data. Non-real-time flows 20 may include any delay-tolerant ttaffie, 
for examp.e, IP data. Flows that transmit other types of delay-sensitive traffic such as 
voice ttaffie or other real-time traffic may be used in place of or in addition to real-trme 

S ^ ^System 10 may receive any suitable type of traffic, for example, moving pictures 
experts group-2 (MPEG-2) or MPEG-4 video traffic, voice over Interne, protocol (VOIP), 
or interne, protocol (IP) packet traffic. The traffic may be classified aocordmg to jrtter 
tolerance. According to one embodiment, ttaffie that is jitter tolerant comprises non-real- 
toe ttaffie, and ttaffie that is no, jitter toieran, comprises real-time ttaffie. Jrtter tolerant 
traffic, however, may comprise any traffic mat is jitter tolerant according to any surtab.e 
definition of "jitter tolerant," and jitter intolerant ttaffie may comprise any ttaffie that » 
not jitter tolerant For example, jitter intolerant traffic may include vo.ee ttaffie. 
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System 10 includes real-time per-flow queues 40, non-real-time per-flow queues 
30, and a processor 80. Real-time per-flow queues 40 buffer real-time traffic from real- 
time flows 15, and non-real-time per-flow queues 30 buffer non-real-time traffic from 
non-real-time flows 20. Each real-time per-flow queue 40a may receive from real-time 

5 flows 15 a real-time flow 15a corresponding to the real-time per-flow queue 40a. 
Similarly, each non-real-time per-flow queue 30a receives a non-real-time flow 20a 
associated with the non-real-time per-flow queue 30a. As used in this document, "each" 
refers to each member of a set or each member of a subset of the set. Any number n v of 
real-time flows 15 may be used and any suitable number n d of non-real-time flows 20 may 

10 be used. Similarly, any suitable number of real-time per-flow queues 40« v and non-real- 
time per-flow queues 30» rf may be used. According to one embodiment, queues that 
queue other types of traffic such as voice traffic or other real-time traffic may be used in 
place of or in addition to real-time per-flow queues 40 or non-real-time per-flow queues 
30. 

15 Processor 80 manages the encapsulation process that starts when an incoming 

packet is received at a real-time per-flow queue 40. Processor 80 determines if the packets 
accumulated at the real-time per-flow queue 40 form an encapsulation section of a 
maximum section size. If the packets do not form an encapsulation section of a maximum 
section size, processor 80 determines if a current encapsulation efficiency of the 

20 accumulated packets satisfies an encapsulation efficiency threshold. Processor 80 may 
predict a next packet size to determine if the current encapsulation efficiency would 
improve by waiting for the next packet. Processor 80 may also predict a next packet 
arrival time to determine whether a jitter requirement would be violated by waiting for the 
next packet. The processor 80 may adjust the size of sections to be encapsulated at the 

25 corresponding real-time per-flow queues 40, and may also adjust the number of cells 
formed from the encapsulated sections. In addition, processor 80 may adjust the number 
of packets received from non-real-time per-flow queues 30 that are encapsulated to form 
sections and cells. 

Encapsulation sections from queues 40 and 30 are formed into cells. Cells of real- 
30 time encapsulation sections are copied into common real-time buffer 50, and cells of non- 
real-time encapsulation sections are copied into common non-real time buffer 55. The 
cells of an encapsulation section may be copied sequentially into real-time buffer 50 or 
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non-real time buffer 55 such that the cells are not interleaved by cells of another 
encapsulation section. Real-time buffer 50 and non-real time buffer 55 may process the 
cells according to a first-in-first-out procedure. According to one embodiment, buffers 
that buffer other types of traffic such as voice traffic or other real-time traffic may be used 
in place of or in addition to real-time buffer 50 or non-real time buffer 55. 

System 1 0 may also include a scheduler 60 that outputs real-time cells from real- 
time buffer 50 and non-real-time cells from non-real time buffer 55. Cells received at the 
real-time buffer 50 and non-real time buffer 55 may be handled by the scheduler 60 in 
order of priority. For example, real-time cells associated with the real-time buffer 50 may 
be assigned higher priority than non-real-time cells associated with the non-real time 
buffer 55 such that non-real-time cells from non-real time buffer 55 are transmitted only if 
real-time buffer 50 is empty. Accordingly, non-real time buffer 55 may be sufficiently 
large to store delayed non-real-time encapsulation sections. The scheduler 60 may further 
transmit the cells from the real-time buffer 50 and non-real time buffer 55 to a receiver 70. 
Any other suitable priority-scheduling schemes may be used to arbitrate between the real- 
time buffers and the non-real-time buffers. 

To summarize, system 10 encapsulates packets to form encapsulation sections. 
The number of packets to be encapsulated at each real-time per-flow queue 40 is adjusted 
in response to an encapsulation efficiency threshold and a jitter requirement, with the goal 
of reducing jitter while maintaining efficiency. Encapsulation sections are formed into 
cells. One embodiment of the formation of cells from encapsulation sections is to be 
described with reference to FIGURE 2. A cell flow may be transmitted to receiver 70. 
One embodiment of a cell flow is described with reference to FIGURE 3. A method for 
determining when to encapsulate packets is described with reference to FIGURE 4. 
Another embodiment of the formation of cells from encapsulation sections is described 
with reference to FIGURE 5. Another embodiment of a cell flow is described with 
reference to FIGURE 6. 

FIGURE 2 illustrates an embodiment of the formation of cells 250 from 
encapsulation section 200. According to one embodiment, encapsulation section 200 may 
comprise a Multi-Protocol Encapsulation (MPE) section. Encapsulation section 200 
includes a section header 210, section data 212, and a section footer 214. Section header 
210 may include, for example, digital video broadcasting (DVB) Multi-Protocol 
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Encapsulation (MPE) header data. Section header 210 may also include, for example, 
Digital Storage Media Command and Control (DSM-CC) header data. Section data 212 
includes packets 216. According to one embodiment, each packet 216 may comprise an 
IP packet or datagram. Section footer 214 may include, for example, error correction 
5 codes. According to one embodiment, datagram sizes are variable, while section header 
210 has, for example, 20 bytes, and section footer 214 has, for example, 4 bytes. 

According to one embodiment, encapsulation section 200 may be formed into cells 
250. Each cell 250 includes a cell header 220, a payload 240, and a cell footer 230. Cell 
header 220 may include, for example, MPEG-2 packet header data. Cell footer 230 may 
10 include, for example, MPEG-2 packet footer data. Payload 240 may include MPEG-2 
packets which have, according to one embodiment, 184 bytes. 

According to one embodiment, an encapsulation section 200 may be formed into 
one or more sequential cells 250. In the illustrated example, a cell 250a may be loaded 
with a first portion of section 200, a next cell 250b may be loaded with a continuing 
1 5 portion of section 200, and a cell 250c may be loaded with a last portion of section 200. In 
general, cells 250 may be formed sequentially until the encapsulation section 200 has been 
fragmented into one or more cells 250. According to one embodiment, a cell 250 loaded 
with a last portion of an encapsulation section 200 may include additional capacity 280. 
In the illustrated example, a last portion 245 of encapsulation section 200, comprising a 
20 section data 216c and section footers 214, is loaded into the payload of cell 250c to form a 
loaded portion of the payload 240c. The last portion 245 does not fill the capacity of the 
payload, so cell 250c has additional capacity 280. However, cells 250 may be formed in 
any other suitable manner. For example, another embodiment of forrning cells 250 is 
described with reference to FIGURES 5 and 6. 
25 FIGURE 3 illustrates an embodiment of a cell flow 300 resulting from the 

formation of cells 250 as described with reference to FIGURE 2. In general, the cell flow 
300 may include cells 250 ordered sequentially, consecutively, successively, serially, or in 
any similar manner therewith. According to one embodiment, each cell 250 may include, 
for example, IP cells or datagrams 240. In the illustrated example, a last portion of cell 
250c associated with datagram 240c may be followed by a first portion of a cell 250d 
associated with datagram 240d. According to one embodiment, a cell 250c may include 
additional capacity 280. Additional capacity 280 may result from the formation of cells as 
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illustrated in FIGURE 2. In the illustrated example, a cell flow 300 containing additional 
capacity 280 may contribute to a delay 350. Delay 350 or jitter experienced in a cell flow 
300 may be calculated as the time lapsed between a last IP datagram 240c and next IP 
datagram 240d. Cell flow 300 may be formed in any other suitable manner, for example, 
5 with the exclusion of additional capacity 280 as described with reference to FIGURES 5 
and 6. 

FIGURE 4 is a flowchart illustrating an embodiment of a method for encapsulating 
IP packets. The following parameters may be used to perform calculations described in 



the examples illustrated with reference to FIGURE 4. 



Parameter 


Definition 


n 


Total number of real-time and non-real-time flows. 


n v 


Number of real-time flows 


n d 


Number of non-real-time flows 


iix) 


Encapsulation efficiency for a section with an % -byte payload 


■Hopt 


Optimal encapsulation efficiency 


■ n 


Threshold that defines the minimum acceptable encapsulation 
efficiency for real-time traffic 


"Hnrt 


lnresnold. tnat uennes tne munmum accepuiDic cniy<ip&uianuii 
einciency ior non-re«ti umc irdiin/ 




Optimal payload size for a section 


Ti(i) 


/th cell inter-arrival time in the z'th flow 


StO) 


Size (in bytes) of the /'th cell in the /'th flow 


Winter (i J) 


Exponentially weighted moving average of T,<j) 


l^size (l, j) 


Exponentially weighted moving average of Si(j) 


Xi(j) 


Tj(i)-Hinter(i,j) 


SiO) 


Si(D - Hsize (i j) 


jf inter 


Forgetting factor for updating p.inter(i, j) 


ffsize 


Forgetting factor for updating Psi ze (i, j) 


Ti(m;r) 


r-step forecast for the inter-arrival time of the z'th flow, starting 
form the mth inter-arrival time 


Si(m;r) 


r-step forecast for the cell size of the z'th flow, starting from the 
mth cell size 


a,(m) 


Coefficient of the autoregressive(l) model for the cell inter-arrival 
time in the z'th flow after the arrival of the mth cell 


d,(m) 


Estimated value of a,, (m) 


P,(«0 


Coefficient of the autoregressive(l) model for the cell size in the 
z'th flow after the arrival of the mth cell 


0,0") 


Estimated value of $i(m) 


Qmax 


Maximum number of bytes of an encapsulation section 


Qrt 


Number of MPEG2 packets in the real-time buffer at the current 
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time 


it j * ' 


Predicted number of 0«r after / seconds 




Worst case jitter experienced by cells of the z'th flow 


J 

«z 


Predicted value of rf, after one (future) inter-arrival time 


A 


Jitter requirement for the z'th flow 


Rencap 


Output rate of the encapsulator in bps 


Ri 


Peak input rate for the z'th flow in bps 


c(0 
& tot 


Number of bytes in the z'th per-flow queue at a given time instant 


— 371 — I 


Predicted value of Sf iJ to i after x seconds 


«■» current 


Size of the most recent cell to arrive from the z'th flow in seconds 


6(0 

«J next 


Predicted size of the subsequent inter-arrival interval in the z'th 
flow in seconds 


J current 


Duration of the most recent inter-arrival time in the z'th flow (in 
seconds) 


f (0 

current 


Predicted length of the subsequent inter-arrival interval in the zth 
flow (in seconds) 


& ^startOO 


Arrival time of the first bit of the kth cell in the z'th flow 


t start,] 


Arrival time for the first bit of the last cell of an MPE section in 
the z'th flow 


* j/art.2 


Arrival time for the first bit of the first cell of an MPE section in 
the z'th flow 


JO 

* Jinisn, s 


Departure time for the first bit of the last cell of an MPE section in 
the z'th flow 


JO 

* finish.2 


Departure time for the first bit of the first cell of an MPE section 
in the z'th flow 


;(/) 

1 finish, 2 


Predicted value of f } fmish,2 




r (i) +SS (i) IR 

x next ~ 00 next ' * v l 


^current 


Current time at the encapsulator 


'"last 


Index of the most recent cell to arrive at the/th queue 



In the illustrated method, packets are received at the per-flow queues 40 and 30 
from real-time flows 15 and non-real-time flows 20. As an example, a packet of real-time 
flow 15a is received by real-time per-flow queue 40a. In describing the embodiment of 
5 FIGURE 4, the term "per-flow queue" refers to a real-time per-flow queue 40 or a non- 
real-time per-flow queue 30. 

The method begins at step 400, where a per-flow queue receives a packet. The 
method then proceeds to step 402, where the size of an encapsulation section including the 
received packet is compared to a maximum number of bytes Q nia x of an encapsulation 
10 section. The size of an encapsulation section describes the combined sizes of the one or 
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more packets stored at the per-flow queue. According to one embodiment, the maximum 
number of bytes Q max may be 4080 bytes. If the size of the encapsulation section exceeds 
the maximum number of bytes Q max associated with the per-flow queue, the method 
proceeds to step 416 to encapsulate the packet. 
5 If the size of the encapsulation section does not satisfy the maximum number of 

bytes Q„,ax associated with the per-flow queue, the method proceeds to step 404 to 
determine if a current encapsulation efficiency 77(x) of the one or more packets 
accumulated at the per-flow queue satisfies a first threshold. In general, step 404 
determines if a current encapsulation efficiency tj(%) satisfies a real-time encapsulation 

10 efficiency threshold r\ n or a non-real time encapsulation efficiency threshold n^. 
According to one embodiment, the current encapsulation efficiency may be defined as, for 
example, the ratio of a number % of payload bytes associated with an encapsulation 
section comprising one or more packets accumulated in the per-flow queue to the total 
number of bytes of the encapsulation section. According to one embodiment, the payload 

15 bytes refer to the IP-traffic bytes that generate an encapsulation section. Accordingly, the 
current encapsulation efficiency may be described by Equation (1): 

r?(z) = — nf«45T' for 1<= x <= 408 ° (1) 

20 where [7] is the ceiling function. Referring to Equation (1), the larger the value of the 
number x of payload bytes, the higher the current encapsulation efficiency rj(x). 
However, the trend may not be monotonic due to padding of unused bytes in a cell. For 
example, the optimal efficiency rj^, for one embodiment, is achieved when 
number x = S opt = 4024 bytes, as described by Equation (2): 

25 

T} opt = max Tjiz) = Tl (4024) = 89.66% (2) 

According to one embodiment, real-time encapsulation efficiency threshold r^and 
non-real time encapsulation efficiency threshold n^ are predetenruned encapsulation 
30 efficiency thresholds associated with a corresponding real-time or non-real-time per-flow 
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queue respectively. An encapsulation efficiency threshold may describe a minimum 
a cceptab>e encapsulation efficiency. For example, the value of threshold ,„ may be set 
approximately at 80%. To summarize step 404, a current encapsulation effictency „(x> 
for packets received a. the per-flow queue is obtained & om Equation (1). The current 
5 encapsulation efficiency rfx) is compared with an encapsulation efficiency threshold to 
determine if the encapsulation efficiency threshold has been satisfied. If Ore current 
encapsulation efficiency does no. satisfy the encapsulation efficiency thresbo.d at step 
404, the method proceeds to step 420 to wait for the next packet. 

If the current encapsulation efficiency satisfies the encapsulation effictency 
10 tnresho,d at step 404, fire metbod proceeds to steps 406 and 408 to predict a next 
encapsulation efficiency and a next packet arriva. time. According to one embodiment, 
next encapsulation efficiency may be associated with one or more packets mcludmg a 
predicted next packet accumulated a, a per-flow queue. In the illustrated example, 
predicting the next encapsulation efficiency comprises predicting a next packet srze. The 
15 next packet arrival time is calculated to predict delay. 

According to one embodiment, steps 406 and 408 are calculated, for example, 
using a recursion procedure. According ,0 another embodiment, predicting a next packet 
size and predicting a next packet arrival time may be obtained by an iterative 
any other procedure suitable to generate the predicted values of a next packet stze and a 

20 next packet arrival time. 

For example, steps 406 and 408 may be performed in the foUowmg manner. A 
predicted next packet size «fl>. used to calculate a next encapsulation efficiency a, step 
406 maybeassociatedwiurthesizeofbytesoftheythpacketoftbeithflow. Snmlariy, a 
predicted next packet arrival time W is associated with ft. J* packet arrive time of the 
25 1 queue flow. The exponentially weighted moving averages (BMW As) of W «* *» 
may be defined as ^ij) and p_ (ij) given by Equations (3) and (4), respectively: 



30 
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where^ and Jf,,, are forgetting factors that determine the degree of adaphveness in the 

estimation of the moving averages. 

According to one embodiment, the next encapsulation efficiency calculated at step 
406 and the prediction of next packet arrival time calculated at step 408, may include 

5 modeling a sequence according to an autoregressive model. In the illustrated example, an 
arrival time sequence may be modeled by defining M) - T® - |Wl J» and a packet 
size sequence maybe modeled by defining (s i0 ) - W - p*. 0M where r i( j) and s i0 ) are 
normalized, zero-mean, packet inter-arrival times and sizes, respectively. Thus, according 
to one embodiment, for each i, the sequences M) ^U,-) *»d (s,<j) :^1A..0 may be 

10 obtained according to an autoregressive model of order one (AR(1)) with time-varying 
coefficients as described by Equations (5) and (6): 

r, (k + l) = a, (fy, (k) + CTjC (k + l),k = 1,2,... (5) 

15 + 1) = (*) + & s & +l) ' k = 1 ' 2 '- (6) 

where a i( k) and %(k) are time-varying coefficients, :j = lA-> is a se <* uence ° f 
independent identically distributed zero-mean random variables of the noise processes, 
and « and fi are variance-related coefficients of the noise processes. The modehng of a 
20 sequence may be performed using any autoregressive techniques. 

As discussed previously, the predicted size of the next packet Stf) and predicted 
next packet arrival time T i0 ) are determined at steps 406 and 408, respectively. For an ith 
per-flow queue flow, where z = 1,2,..., n v , and,' packets, where, =1, 2,..., m, and m is the 
index of the most recent packet to arrive at the encapsulator, the predicted values of T® 
25 and S i( j) for,' > m during the r-step of a recursion procedure are described respechvely by 
Equations (7) and (8): 

f;.(m;r) = (a i (m)) r (r f (m)-// inter (/,w)) + *W 0>0 ( 7 > 



30 5.(m; r) = (A(»0)" (5 f (m) - // Jfee 0>0) + |x*.0".w) 



(8) 



where the adjusted coefficients d,M and are obtained by minimizing the mean- 

square error as described by Equations (9) and (10): 



BNSOOC1D: <WO 2004082203A 1 _l_> 



WO 2..04/06220J PCT/US2003/W30957 



12 



d f (»o=^ ' , (9) 



( . W .S^ (10) 

As previously described, the illustrated method may use a recursion procedure. 
According to one embodiment, the adjusted coefficient d,(ro) may be generated 
recursively each time a next packet arrival time needs to be predicted. To predict a next 
10 packet arrival time called for at step 408, a value for d,(ro) may be determined using 
recursive variables Yi(k) and Z t (k) as defined by Equations (1 1) and (12): 



r f (Jt) = tr,0)r ( (;+i) = i;(*-D+J;(W+i) (") 

7=« 



15 z f (Jt) = ttfCO-z.tf-i) d2) 

7-1 i 

where the r-step prediction may be obtained using the following procedure once the roth 
measurement for the last arrival time is available: 

20 For all i = 1, . . . ,n v .do 

(Initialization) After the arrival of the first packet, do 

f / a;r) = M- fater (U)=r i (i) 

r,=o 

z f =o 

25 (Recursion) For each subsequent cell arrival, m, do 

Update EMWA: /W (i, m) = jfo^ 0'> w - 1) + 0 " Kter) T i (™) 
^.=F i+ 7;.(m-l)7;.(m) 
Zi = Zi + i;. 2 (m-l) 
d I -(ro) = r / /Z i 

30 7;. (ro; r) = (a f (ro)) r (T, (m) - /W (i, m)) + 0', ™) 

End-recursion 
End-for 
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The prediction of the next encapsulation efficiency at step 406 may be determined 
using a similar recursion procedure. Once the prediction of next encapsulation efficiency 
is determined, the method proceeds to step 410 to determine if the predicted next 
5 encapsulation efficiency exceeds the current encapsulation efficiency previously 
determined at step 404 by Equation (1). If the next encapsulation efficiency is lower than 
the current encapsulation efficiency, the method proceeds to step 416 to encapsulate the 
packets accumulated at the per-flow queue. 

If the next encapsulation efficiency is higher than the current encapsulation 
10 efficiency, the method proceeds to step 412 to determine the expected delay associated 
with receiving the next packet. In the illustrated method, the expected delay may be 
defined as the absolute value of the difference between the delay of the first packet at the 
encapsulator and the delay of the next packet. According to one embodiment, when a first 
packet arrives at the encapsulator, the time of arrival of the first packet is noted until the 
15 value is updated with the time of arrival of a subsequent or next packet. The time of 
arrival of the first bit of the Mi packet in the ith flow queue may be represented by 

,«,(*), where and £=1,2 n v . The times of arrival and departure for the first 

bit of a first packet may be represented by ^ lart j and Similarly, the times of 

arrival and departure for the first bit of a second packet may be represented by tf'^rt.2 and 
20 Pfinish.2- The expected delay d t may be defined by Equation (13): 

d, = maX\0,^)4i >2 -tf M kh.l) Vi<art.2 l starl.\Ji V ' 

In the worst case, the computation of d { may be performed after each packet arrives at the 

25 per-flow queue. 

To initialize the process of deternnning delay d t at step 412, f } s t a n.i = t ' finishj = 0 
and Pstartj = ^starui- Subsequently, when an encapsulation section is formed, the value of 
is updated and used to update f> fmish ,i as described by Equation (14): 



8S«> QRT + 

AO _,(') .^current 



c(«) _ S (l) + 20 



184 



.III yV'J I current ■ 

30 Ri + Rencap 

(204)(8) 



(14) 
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where Sf> is .he current number ofby.es in .be per-flow queue, S<L» h size of the 
mo , recent packet .o arrive ftom .be .th per-flow queue, * is .he peak ra.e in b,s per 
second of the rth flow, * w is .be ra.e of the e„eapsu,,or in bps, and Qrt is the nnnrber 
of encapsu,a.ed ceHs in .he real-time per-flow queue 40 a, the .ime of compuhng f 

ZD ™ he aenerated by, for example, usmg 
Aeeording to one embodiment, time (</„„„,., may be gener y, 

expression /'V, * « «■ * « ^ * " 

packe, arrives. After the encapsulation section including the first packet ts formed, the 

value of time ^,„r/.2 is updated. 

Determining the delay *of Eqnafion (13, a, step 412 may reqnire fire predion of 
.ime V The predicted valne of rime may be referred to as ,» and 

described by Equation (1 5): 



t finish* ~ /? 



(15) 



15 where: 



' " * next 



(16) 



and (T'.M is the predicted number of cells a. .he real-rime buffer 50 after , seconds 
20 ftom fire current rime t^Qff (0) = &,)• The predicted packet arrival time Jfi and 
the predicted packe. size *U of Equation (16) may be obtained ftom Equations (7) and 

(8) as previously described. 

To generate predicted time f in accordance with Equation (15), the predated 

, w,ffi=r n pred (W^rnax be obtained from Equation 
number of cells at the real-time buffer 50 Q> RT (vr )™*y 

25 (17): 



Q^(pr (0 )«max 



0,Qrt +E 



^>(^ (l) ) + 24 



184 



(204)(8) 



(17) 
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where S$(W <0 ) is described as the number of additional bytes that could accumulate at 
queue j as defined by Equations (18) through (22): 

5 where the recursion variable r* is the largest integer that satisfies Equation (19): 

t=l 

and where mj£ t is the index of the most recent packet to arrive at ihejih queue. 
10 According to one embodiment, the recursion variable r* may be, for example, the 

largest integer that satisfies Equation (20): 



20 



25 



f,fj<m<t>;k)Zt (20) 



15 for any positive real value number t. Thus, using Equation (7) to obtain predicted time 
fj(m^ t ;k) and manipulating the result into Equation (20), a recursion function r(t) may 
be obtained as described by Equation (21): 

rfn< _£_ (r,-^0)X<*; -(*;>'"*') (21) 
/wC/)0-<*,) 



* inter 



Finally, once the recursion function r(t) is generated from Equation (21), for 
example, by using an iterative process, recursion variable r* may be obtained by 
substituting time t in Equation (21) with W (l) +t cumnl -t^(m%) so that a solution for 

(W w ) may be obtained from Equation (22): 

SZ-SgHSj-M+.U)) *' - _ r l ^r*^(J) (22) 

1 "j 
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where (3>P>^,) and S,=S,(m£). Thus, using Equation (22) to obtain 
for each7W,2,...,« v , a value for the predicted number of cells at the real-time buffer 50 

gs-of") raa y be obtained from Equation (17) and therefore a delay * in accordance 

with Equation (13) may be obtained. 

The method proceeds to step 414 to determine if the delay associated with waiting 
for a next packet is within jitter bounds. The jitter bounds may comprise a predetermined 
maximum jitter requirement that functions as a delay threshold for evaluating a delay. 
According to one embodiment, the maximum jitter requirement is, for example, m the 
range of 25 to 35 milliseconds such as approximately 30 milliseconds. The delay 
obtained in step 412 is compared with the jitter requirement. A delay is within jitter 
bounds when the delay is lower than the jitter requirement. If the delay is within jitter 
bounds, that is, the delay is lower than the jitter requirement, the method proceeds to step. 
420 to wait and accumulate the next packet expected at the queue. If the delay is not 
within jitter bounds, that is, the delay is equal to or greater than the jitter requirement, the 
method proceeds to encapsulation of the accumulated packets in the per-flow queue under 
step 416 and to subsequently form cells from the encapsulation section at step 418. Cells 
may be formed in any suitable manner. For example, cells may be formed according to 
the procedure described with reference to FIGURE 2. After forming the cell, the method 
terminates. 

To summarize, if the packets accumulated satisfy the encapsulation efficiency 
threshold, the predicted jitter is evaluated to determine if the accumulated packets are 
encapsulated. If the predicted jitter is low, more packets will be accumulated If the 
predicted jitter is too high, then the accumulated packets are encapsulated. The method 
may include more, fewer, or different steps. The steps of the method may be performed in 
25 any suitable order. For example, the prediction of the arrival time at step 408 may be 
performed after the determination at step 410. 

FIGURE 5 illustrates another embodiment of the formation of cells 550 from 
encapsulation sections 500. According to one embodiment, encapsulation section 500 
may comprise a Multi-Protocol Encapsulation (MPE) section. Each encapsulation section 
30 500 includes a section header 210, section data 215 and 218, and a section footer 214. 
Section header 210 may include, for example, digital video broadcasting (DVB) Mulu- 



20 
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Protocol Encapsulation (MPE) header data. According to one embodiment, section header 
210 may also include, for example, Digital Storage Media Command and Control (DSM- 
CC) header data. Encapsulation section 500a comprises section data 218 and 
encapsulation section 500b compnses section data 215, where each section data 218 and 
215 comprises packets. According to one embodiment, each packet 218 and 215 may 
comprise an IP packet or datagram. Section footer 214 may include, for example, error 
correction codes. Datagram sizes may be variable, while section header 210 has, for 
example, 20 bytes, and section footer 214 has, for example, four bytes. 

Encapsulation section 500 may be formed into cells 550. Each cell 550 includes a 
cell header 220, a payload 540, and a cell footer 230. Cell header 220 may include, for 
example MPEG-2 packet header data. Cell footer 230 may include, for example, MPEG- 
2 packet footer data. Payload 540 may include MPEG-2 packets, which have, accorduvg 

to one embodiment, 184 bytes. 

According to one embodiment, one or more encapsulation sections 500 may be 
> formed into one or more sequential cells 550. In the illustrated example, a cell 550a may 
be loaded with a first portion of encapsulation section 500a, a next cell 550b may be 
loaded with a next portion of encapsulation section 500a, while another cell 550c may be 
' loaded with a last portion of section 500a. In general, cells may be formed sequentially 
until an encapsulation section 500 has been formed into one or more cells. In the 
0 illustrated example, the last portion 580 of encapsulation section 500a may be loaded mto 
a payload 540c of a cell 550c, and a first portion 585 of a next encapsulation section 500b 
is loaded into the payload 540c of cell 550c, so that a condition of having addxtional 
capacity 280 as described by FIGURE 2 is substantially avoided. 

FIGURE 6 illustrates another embodiment of a cell flow 600 resulting from the 
,5 formation of cells 550 described with reference to FIGURE 5. In general, the cell flow 
600 may include packets 212 and 215 ordered sequentially, consecutively, successxvely, 
serially or in any similar manner therewith. According to one embodiment, packets 212 
and 215 may include, for example, IP packets or datagrams. In the illustrated example, the 
cell flow 600 may include cell footer 610 and cell header 620 that may cause a delay 350. 
30 Tne delay may result substantially from cell footer 610 and cell header 620 or may include 
any other suitable content. According to one embodiment, a cell flow 600 may be 
obtained to improve a delay or jitter. In the illustrated example, there may be a smaller 
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delay 350 at a cell flow 600 described by FIGURE 6 compared to the delay 350 described 
by FIGURE 3, where an additional capacity 280 contributes to the content of the delay in 
the embodiment shown in FIGURE 3. A cell flow 600 as described by FIGURE 6 may 
therefore improve the delay 350 associated with receiving packets 212 and 215 when, for 

5 example, an additional capacity as described by FIGURE 3 has been substantially avoided. 

Certain embodiments of the invention may provide one or more technical 
advantages. A technical advantage of one embodiment may be that the size of an 
encapsulation section is adjusted in response to a current encapsulation efficiency and a 
predicted jitter in an effort to control jitter while maintaining efficiency. If the packets 

10 accumulated do not satisfy a predicted encapsulation efficiency threshold, the packets are 
encapsulated to maintain efficiency. Another technical advantage of an example may be 
that a delay associated with receiving predicted packets may be determined and if the 
delay satisfies a jitter requirement, the accumulated packets may be encapsulated to 
control jitter. Another technical advantage of an example may be that encapsulation 

15 sections packets may be formed into cells to improve jitter. The encapsulation sections 
maybe formed into cells so that additional capacity in the cells is avoided. 

Although an embodiment of the invention and its advantages are described in 
detail, a person skilled in the art could make various alterations, additions, and omissions 
without departing from the spirit and scope of the present invention as defined by the 

20 appended claims. 
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WHAT IS CT AIMED IS: 

1 . A method for encapsulating packets, comprising: 
receiving a plurality of packets at an encapsulator comprising a queue; 
repeating the following for each packet of a subset of the plurality of packets until 
5 the subset o f the plurality of packets is encapsulated: 
accumulating a packet at the queue; 

determining a current encapsulation efficiency associated with one or more 

packets accumulated at the queue; 

predicting a next encapsulation efficiency associated with the one or more 

10 packets accumulated at the queue and with a predicted next packet; 

encapsulating the one or more packets accumulated at the queue if the 
current encapsulation efficiency satisfies an encapsulation efficiency threshold and if the 
current encapsulation efficiency is greater than the next encapsulation efficiency; and 
generating a section from the encapsulated packets. 

15 

2. The method of claim 1, wherein repeating the following for each packet of 
a subset of the plurality of packets until the subset of the plurality of packets is 
encapsulated further comprises: 

determining a section size associated with the one or more packets accumulated at 

20 the queue; and 

encapsulating the one or more packets accumulated at the queue if the section size 
satisfies a maximum section size. 

3. The method of claim 1, wherein repeating the following for each packet of 
25 a subset of the plurality of packets until the subset of the plurality of packets is 

encapsulated further comprises: 

predicting a delay associated with the packet and a next packet; and 

encapsulating the one or more packets accumulated at the queue if the delay does 

not satisfy a jitter requirement. 

30 
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4. The method of claim 1, wherein the encapsulation efficiency threshold 
comprises a minimum encapsulation efficiency. 

5. The method of claim 1, wherein the current encapsulation efficiency 
5 comprises a ratio of a number of payload bytes associated with a predicted section 

comprising the one or more packets accumulated at the queue to a total number of bytes of 
the predicted section comprising the one or more packets. 

6. The method of claim 1, wherein predicting a next encapsulation efficiency 
10 associated with the one or more packets accumulated at the queue and with a predicted 

next packet comprises: 

predicting a next packet size; and 

calculating the next encapsulation efficiency in accordance with the next packet 



15 



20 



25 



size. 



7. The method of claim 1, wherein predicting a next encapsulation efficiency 
associated with the one or more packets accumulated at the queue and with a predicted 

next packet comprises: 

predicting a next packet size according to an autoregressive model; and 
calculating the next encapsulation efficiency in accordance with the next packet 



size. 



8. The method of claim 1, further comprising forming a cell comprising at 
least a portion of the section. 

9. The method of claim 1 , further comprising: 

forming a first cell comprising at least a portion of the section, the first cell 
comprising additional payload capacity; and 

forming a second cell comprising a next section. 
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10. The method of claim 1, farther comprising forming a cell comprising a first 
portion of the section and a second portion of a next section. 

11. The method of claim 3, wherein predicting a delay associated with the 
5 packet and a next packet comprises: 

recording a first arrival time and a first departure time of the packet; 
recording a second arrival time of a next packet; 
predicting a second departure time of the next packet; 
' generating a first difference between the first departure time and the second 

10 departure time; 

generating a second difference between the first arrival time and the second arrival 

time; and 

predicting the delay in accordance with the first difference and the second 
difference. 

15 

12. The method of claim 3, wherein the jitter requirement comprises a 
maximum jitter requirement. 
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13. A system for encapsulating packets, comprising: 
a queue operable to receive a plurality of packets; and 
a processor coupled to the queue and operable to: 
5 repeat the following for each packet of a subset of the plurality of packets 

until the subset of the plurality of packets is encapsulated: 
accumulating a packet at the queue; 

determining a current encapsulation efficiency associated with one 

or more packets accumulated at the queue; 
1Q predicting a next encapsulation efficiency associated with the one or 

more packets accumulated at the queue and with a predicted next packet; 

encapsulating the one or more packets accumulated at the queue if 

the current encapsulation efficiency satisfies an encapsulation efficiency threshold and if 

the current encapsulation efficiency is greater than the next encapsulation efficiency; and 
! 5 generate a section from the encapsulated packets. 

14. The system of claim 13, further comprising: 

at least one buffer operable to receive a plurality of cells from the queue, the at 
least one buffer comprising at least one real-time buffer associated with a first priority; 
20 and 

a scheduler operable to control a flow of the plurality of cells from the at least one 
buffer, the scheduler being operable to grant priority to the plurality of cells received from 
the at least one real-time buffer. 

25 15 . The system of claim 13, wherein the processor operates to: 

determine a section size associated with the one or more packets accumulated at 

the queue; and 

encapsulate the one or more packets accumulated at the queue if the section size 
satisfies a maximum section size. 



BNSDOC1D: <WO 2004062203A 1 _l_> 



5 



PCT/US2003/030957 
WO 2004/062203 



23 

1 6 . The system of claim 1 3 , wherein the processor operates to : 
predict a delay associated with the packet and a next packet; and 
encapsulate the one or more packets accumulated at the queue if the delay does not 

satisfy a jitter requirement. 

17. The system of claim 13, wherein the encapsulation efficiency threshold 
comprises a lmnimum encapsulation efficiency. 

18. The system of claim 13, wherein the current encapsulation efficiency 
10 comprises a ratio of a number of payload bytes associated with a predicted section 

comprising the one or more packets accumulated at the queue to a total number of bytes of 
the predicted section comprising the one or more packets. 

19. The system of claim 13, wherein the processor operates to: 
1 5 predict a next packet size; and 

calculate the next encapsulation efficiency in accordance with the next packet size. 

20. The system of claim 13, wherein the processor operates to: 
predict a next packet size according to an autoregressive model; and 

20 calculate the next encapsulation efficiency in accordance with the next packet size. 

21. The system of claim 13, wherein the processor operates to form a cell 
comprising at least a portion of the section. 

25 22. The system of claim 13, wherein the processor operates to: 

form a first cell comprising at least a portion of the section, the first cell 
comprising additional payload capacity, and 

form a second cell comprising a next section. 



30 23. The system of claim 13, wherein the processor operates to form a cell 

comprising a first portion of the section and a second portion of a next section. 
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24. The system of claim 15, wherein the processor operates to: 
record a first arrival time and a first departure time of the packet; 
record a second arrival time of a next packet; 
predict a second departure time of the next packet; 

generate a first difference between the first departure time and the second 

departure time; . 

generate a second differer.ee between the firs, arrival time and the seeond amval 

time; and 

prediet the delay in aeeordanee with the first differenee and the second dtfferenoe. 

25. The system of claim 16, wherein the jitter requirement comprises a 
maximum jitter requirement. 
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26. A method for encapsulating packets comprising: 
receiving a plurality of packets at an encapsulator comprising a queue; 
repeating the following for each packet of a subset of the plurality of packets until 
the subset of the plurality of packets is encapsulated: 
5 accumulating a packet at the queue; 

predicting a delay associated with the packet and a predicted next packet; 

and 

encapsulating the one or more packets accumulated at the queue if the 
delay does not satisfy a jitter requirement; and 
1 0 generating a section from the encapsulated packets. 

27. The method of claim 26, wherein predicting a delay associated with the 
packet and a next packet comprises: 

recording a first arrival time and a first departure time of the packet; 
1 5 recording a second arrival time of the next packet; 

predicting a second departure time of the next packet; 

generating a first difference between the first departure time and the second 
departure time; 

generating a second difference between the first arrival time and the second arrival 
20 time; and 

predicting the delay in accordance with the first difference and the second 
difference. 

28. The method of claim 26, wherein predicting a delay associated with the 
25 packet and a next packet comprises: 

predicting a next packet arrival time according to an autoregressive model; and 
calculating the delay in accordance with the next packet arrival time. 

29. The method of claim 26, wherein the jitter requirement comprises a 
30 maximum jitter requirement. 
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30. A system for encapsulating packets, comprising: 
a means for receiving a plurality of packets; and 

a means for repeating the following for each packet of a subset of the plurahty of 
packets until the subset of the plurality of packets is encapsulated: 
accumulating a packet at the queue; 

deternaining a current encapsulation efficiency associated with one or more 

packets accumulated at the queue; 

predicting a next encapsulation efficiency assorted with the one or more 

packets accumulated at the queue and with a predicted next packet; 

encapsulating the one or more packets accumulated a. the queue rf the 
current encapsulate efficiency satisfies an encapsnlation efficiency threshold and rf the 
current encapsulation efficiency is greater than the next encapsulation efficiency; and 
means for generating a section from the encapsulated packets. 
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31. A method for encapsulating packets, comprising: 
receiving a plurality of packets at an encapsulator comprising a queue; 
repeating the following for each packet of a subset of the plurality of packets until 
the subset of the plurality of packets is encapsulated: 
5 accumulating a packet at the queue; 

determining a current encapsulation efficiency associated with one or more 
packets accumulated at the queue, the current encapsulation efficiency comprising a ratio 
of a number of payload bytes associated with a predicted section comprising the one or 
more packets accumulated at the queue to the total number of bytes of the predicted 
1 0 section comprising the one or more packets ; 

determining a section size associated with the one or more packets 

accumulated at the queue; 

encapsulating the one or more packets accumulated at the queue if the 

section size satisfies a maximum section size; 
15 predicting a next encapsulation efficiency associated with the one or more 

packets accumulated at the queue and with a predicted next packet; 

encapsulating the one or more packets accumulated at the queue if the 
current encapsulation efficiency satisfies a minimum encapsulation efficiency and if the 
current encapsulation efficiency is greater than the next encapsulation efficiency; 
20 predicting a delay associated with the packet and a next packet; 

encapsulating the one or more packets accumulated at the queue if the 
delay does not satisfy a maximum jitter requirement; 

generating a section from the encapsulated packets; and 
forming a cell comprising at least a portion of the section. 
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